Sign Language Avatars: Animation and Comprehensibility
Identifieur interne : 000299 ( Main/Exploration ); précédent : 000298; suivant : 000300Sign Language Avatars: Animation and Comprehensibility
Auteurs : Michael Kipp [Allemagne] ; Alexis Heloir [Allemagne] ; Quan Nguyen [Allemagne]Source :
- Lecture Notes in Computer Science [ 0302-9743 ] ; 2011.
English descriptors
- Teeft :
- American sign language, American sign language generation, Animation, Autonomous agents, Avatar, Avatar extensions, Avatar technology, Avatar version, Basic vocabulary, Behaviorbuilder tool, Cambridge university press, Comprehensibility, Comprehensibility levels, Control condition, Conversational agents, Coverbal gesture, Deaf assistant, Deaf experts, Deaf individuals, Deaf people, Deaf users, Delta evaluation, Delta testing, Embr, Evaluation methods, Evaluation studies, Facial expression, German sign language, Gloss, Hamnosys, Hand shape, Hand shapes, Hearing students, Heloir, Human signers, International conference, Internet pages, Kipp, Language resources, Limited comprehensibility, Lower boundary, Morph targets, Multiagent systems, Native language, Necessary tools, Nguyen, Nonmanual components, Nonmanuals, Notable exception, Notation, Objective measure, Original video, Production cost, Second language, Short development time, Sign language, Sign language avatars, Sign language studies, Sign language synthesis, Sign languages, Signer, Single glosses, Single sign, Single signs, Technical feasibility, Upper body control, Utterance, Utterance level, Video, Video recordings.
Abstract
Abstract: Many deaf people have significant reading problems. Written content, e.g. on internet pages, is therefore not fully accessible for them. Embodied agents have the potential to communicate in the native language of this cultural group: sign language. However, state-of-the-art systems have limited comprehensibility and standard evaluation methods are missing. In this paper, we present methods and discuss challenges for the creation and evaluation of a signing avatar. We extended the existing EMBR character animation system with prerequisite functionality, created a gloss-based animation tool and developed a cyclic content creation workflow with the help of two deaf sign language experts. For evaluation, we introduce delta testing, a novel way of assessing comprehensibility by comparing avatars with human signers. While our system reached state-of-the-art comprehensibility in a short development time we argue that future research needs to focus on nonmanual aspects and prosody to reach the comprehensibility levels of human signers.
Url:
DOI: 10.1007/978-3-642-23974-8_13
Affiliations:
Links toward previous steps (curation, corpus...)
- to stream Istex, to step Corpus: 001035
- to stream Istex, to step Curation: 000F56
- to stream Istex, to step Checkpoint: 000160
- to stream Main, to step Merge: 000299
- to stream Main, to step Curation: 000299
Le document en format XML
<record><TEI wicri:istexFullTextTei="biblStruct:series"><teiHeader><fileDesc><titleStmt><title xml:lang="en">Sign Language Avatars: Animation and Comprehensibility</title><author><name sortKey="Kipp, Michael" sort="Kipp, Michael" uniqKey="Kipp M" first="Michael" last="Kipp">Michael Kipp</name></author><author><name sortKey="Heloir, Alexis" sort="Heloir, Alexis" uniqKey="Heloir A" first="Alexis" last="Heloir">Alexis Heloir</name></author><author><name sortKey="Nguyen, Quan" sort="Nguyen, Quan" uniqKey="Nguyen Q" first="Quan" last="Nguyen">Quan Nguyen</name></author></titleStmt><publicationStmt><idno type="wicri:source">ISTEX</idno><idno type="RBID">ISTEX:9E3CC0BF8B95B5811B302268F27E8B29029DEF59</idno><date when="2011" year="2011">2011</date><idno type="doi">10.1007/978-3-642-23974-8_13</idno><idno type="url">https://api.istex.fr/document/9E3CC0BF8B95B5811B302268F27E8B29029DEF59/fulltext/pdf</idno><idno type="wicri:Area/Istex/Corpus">001035</idno><idno type="wicri:explorRef" wicri:stream="Istex" wicri:step="Corpus" wicri:corpus="ISTEX">001035</idno><idno type="wicri:Area/Istex/Curation">000F56</idno><idno type="wicri:Area/Istex/Checkpoint">000160</idno><idno type="wicri:explorRef" wicri:stream="Istex" wicri:step="Checkpoint">000160</idno><idno type="wicri:doubleKey">0302-9743:2011:Kipp M:sign:language:avatars</idno><idno type="wicri:Area/Main/Merge">000299</idno><idno type="wicri:Area/Main/Curation">000299</idno><idno type="wicri:Area/Main/Exploration">000299</idno></publicationStmt><sourceDesc><biblStruct><analytic><title level="a" type="main" xml:lang="en">Sign Language Avatars: Animation and Comprehensibility</title><author><name sortKey="Kipp, Michael" sort="Kipp, Michael" uniqKey="Kipp M" first="Michael" last="Kipp">Michael Kipp</name><affiliation wicri:level="3"><country xml:lang="fr">Allemagne</country><wicri:regionArea>DFKI, Embodied Agents Research Group, Saarbrücken</wicri:regionArea><placeName><region type="land" nuts="2">Sarre (Land)</region><settlement type="city">Sarrebruck</settlement></placeName></affiliation><affiliation wicri:level="1"><country wicri:rule="url">Allemagne</country></affiliation></author><author><name sortKey="Heloir, Alexis" sort="Heloir, Alexis" uniqKey="Heloir A" first="Alexis" last="Heloir">Alexis Heloir</name><affiliation wicri:level="3"><country xml:lang="fr">Allemagne</country><wicri:regionArea>DFKI, Embodied Agents Research Group, Saarbrücken</wicri:regionArea><placeName><region type="land" nuts="2">Sarre (Land)</region><settlement type="city">Sarrebruck</settlement></placeName></affiliation><affiliation wicri:level="1"><country wicri:rule="url">Allemagne</country></affiliation></author><author><name sortKey="Nguyen, Quan" sort="Nguyen, Quan" uniqKey="Nguyen Q" first="Quan" last="Nguyen">Quan Nguyen</name><affiliation wicri:level="3"><country xml:lang="fr">Allemagne</country><wicri:regionArea>DFKI, Embodied Agents Research Group, Saarbrücken</wicri:regionArea><placeName><region type="land" nuts="2">Sarre (Land)</region><settlement type="city">Sarrebruck</settlement></placeName></affiliation><affiliation wicri:level="1"><country wicri:rule="url">Allemagne</country></affiliation></author></analytic><monogr></monogr><series><title level="s">Lecture Notes in Computer Science</title><imprint><date>2011</date></imprint><idno type="ISSN">0302-9743</idno><idno type="eISSN">1611-3349</idno><idno type="ISSN">0302-9743</idno></series></biblStruct></sourceDesc><seriesStmt><idno type="ISSN">0302-9743</idno></seriesStmt></fileDesc><profileDesc><textClass><keywords scheme="Teeft" xml:lang="en"><term>American sign language</term><term>American sign language generation</term><term>Animation</term><term>Autonomous agents</term><term>Avatar</term><term>Avatar extensions</term><term>Avatar technology</term><term>Avatar version</term><term>Basic vocabulary</term><term>Behaviorbuilder tool</term><term>Cambridge university press</term><term>Comprehensibility</term><term>Comprehensibility levels</term><term>Control condition</term><term>Conversational agents</term><term>Coverbal gesture</term><term>Deaf assistant</term><term>Deaf experts</term><term>Deaf individuals</term><term>Deaf people</term><term>Deaf users</term><term>Delta evaluation</term><term>Delta testing</term><term>Embr</term><term>Evaluation methods</term><term>Evaluation studies</term><term>Facial expression</term><term>German sign language</term><term>Gloss</term><term>Hamnosys</term><term>Hand shape</term><term>Hand shapes</term><term>Hearing students</term><term>Heloir</term><term>Human signers</term><term>International conference</term><term>Internet pages</term><term>Kipp</term><term>Language resources</term><term>Limited comprehensibility</term><term>Lower boundary</term><term>Morph targets</term><term>Multiagent systems</term><term>Native language</term><term>Necessary tools</term><term>Nguyen</term><term>Nonmanual components</term><term>Nonmanuals</term><term>Notable exception</term><term>Notation</term><term>Objective measure</term><term>Original video</term><term>Production cost</term><term>Second language</term><term>Short development time</term><term>Sign language</term><term>Sign language avatars</term><term>Sign language studies</term><term>Sign language synthesis</term><term>Sign languages</term><term>Signer</term><term>Single glosses</term><term>Single sign</term><term>Single signs</term><term>Technical feasibility</term><term>Upper body control</term><term>Utterance</term><term>Utterance level</term><term>Video</term><term>Video recordings</term></keywords></textClass><langUsage><language ident="en">en</language></langUsage></profileDesc></teiHeader><front><div type="abstract" xml:lang="en">Abstract: Many deaf people have significant reading problems. Written content, e.g. on internet pages, is therefore not fully accessible for them. Embodied agents have the potential to communicate in the native language of this cultural group: sign language. However, state-of-the-art systems have limited comprehensibility and standard evaluation methods are missing. In this paper, we present methods and discuss challenges for the creation and evaluation of a signing avatar. We extended the existing EMBR character animation system with prerequisite functionality, created a gloss-based animation tool and developed a cyclic content creation workflow with the help of two deaf sign language experts. For evaluation, we introduce delta testing, a novel way of assessing comprehensibility by comparing avatars with human signers. While our system reached state-of-the-art comprehensibility in a short development time we argue that future research needs to focus on nonmanual aspects and prosody to reach the comprehensibility levels of human signers.</div></front></TEI><affiliations><list><country><li>Allemagne</li></country><region><li>Sarre (Land)</li></region><settlement><li>Sarrebruck</li></settlement></list><tree><country name="Allemagne"><region name="Sarre (Land)"><name sortKey="Kipp, Michael" sort="Kipp, Michael" uniqKey="Kipp M" first="Michael" last="Kipp">Michael Kipp</name></region><name sortKey="Heloir, Alexis" sort="Heloir, Alexis" uniqKey="Heloir A" first="Alexis" last="Heloir">Alexis Heloir</name><name sortKey="Heloir, Alexis" sort="Heloir, Alexis" uniqKey="Heloir A" first="Alexis" last="Heloir">Alexis Heloir</name><name sortKey="Kipp, Michael" sort="Kipp, Michael" uniqKey="Kipp M" first="Michael" last="Kipp">Michael Kipp</name><name sortKey="Nguyen, Quan" sort="Nguyen, Quan" uniqKey="Nguyen Q" first="Quan" last="Nguyen">Quan Nguyen</name><name sortKey="Nguyen, Quan" sort="Nguyen, Quan" uniqKey="Nguyen Q" first="Quan" last="Nguyen">Quan Nguyen</name></country></tree></affiliations></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Wicri/Sarre/explor/MusicSarreV3/Data/Main/Exploration
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000299 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Main/Exploration/biblio.hfd -nk 000299 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Wicri/Sarre
|area= MusicSarreV3
|flux= Main
|étape= Exploration
|type= RBID
|clé= ISTEX:9E3CC0BF8B95B5811B302268F27E8B29029DEF59
|texte= Sign Language Avatars: Animation and Comprehensibility
}}
| This area was generated with Dilib version V0.6.33. |  |